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Method and device for detecting the attention level of a vehicle operator 

The invention is directed to a method and a device for detecting the attention 
level of a vehicle operator by monitoring a steering performance of the vehicle 
operator, with the features recited in the preambles of claims 1 and 15. 

It is generally known that particularly high demands are placed on the 
attention level (vigilance) of vehicle operators. A decreased attention level of 
the vehicle operator, in particular due to fatigue and/or a monotonous driving 
situation, can increase the likelihood of an accident. 

Methods and devices for improving the attention level of a vehicle operator 
are known. For example, DE 44 00 207 C2 discloses a device and a method 
that correlates heartbeat information of the vehicle operator with steering 
information. Actuation of the steering wheel by the vehicle operator is 
detected with at least one steering angle sensor. Specific time periods before 
the vehicle operator turns the steering wheel clockwise or counterclockwise 
are monitored to detect actuation of the steering wheel by the vehicle 
operator. The underlying concept is here that the operator tends to maintain 
the course of the vehicle with so-called fine-steering periods that occur more 
frequently when the vehicle operator is alert. An absence of these fine- 
steering-periods or a greater time interval between these fine-steering-periods 
could indicate a reduced attention level of the vehicle operator. 



It is generally known that steering performance of a vehicle can be affected 
either intentionally by the operator or by external effects, such as wind gusts, 
poor road conditions and the like, which require course corrections from the 
vehicle operator. 

It is also known to equip vehicles with electronic stabilizer systems (ESP) 
and/or an electric steering assist (EPS). With these systems, an active 
control system detects deviations between the desired performance and the 
actual performance of various components and automatically initiates suitable 
countermeasures, thereby aiding the vehicle operator in steering the vehicle. 

It is therefore an object of the invention to provide a method and a device of 
the aforedescribed type for readily detecting the attention level of a vehicle 
operator. 

According to the invention, the object is solved by a method with the features 
recited in claim 1 . The attention level of a vehicle operator can be easily and 
reliably determined by evaluating a phase relationship between a change of a 
steering angle of at least one steerable wheel of a vehicle and a change of a 
steering wheel angle. The method of the invention is based on the 
observation that the vehicle operator must initiate a counter-steering action to 
correct the desired vehicle course when an external event affects steering of 
the vehicle. The external effect on the vehicle course causes a change in the 
steering angle of at least one steerable wheel of the vehicle, i.e., the actual 
steering angle deviates from the intended steering angle. The vehicle 
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operator uses the steering wheel to counter-steer, so that the change in the 
steering wheel angle is a measure for the steering action of the vehicle 
operator. Due to inevitable reaction times, the phase relationship between the 
steering angle of the at least one steerable wheel and the steering wheel 
angle can be different. This difference between the phase relationship of the 
steering angle and the steering wheel angle is therefore a measure of the 
ability of the vehicle operator to react (reaction speed), so that a diminishing 
reaction speed can readily indicate a reduced attention level of the vehicle 
operator. 

According to an advantageous feature of the invention, the phase relationship 
can be evaluated during time intervals when steering movements of the 
vehicle are not caused by an intentional steering action of the vehicle 
operator. This significantly reduces the complexity for identifying the attention 
level of the vehicle operator. The method for identifying the attention level 
according to the invention is applied only after external steering effects cause 
a steering action of the vehicle. Conversely, the method of the invention is 
preferably inactive during time intervals when the vehicle operator initiates a 
steering action or the steering action is not influenced by an external event. 

According to another advantageous feature of the invention, the phase 
relationship can be evaluated within a time interval where the change of the 
steering wheel angle follows a change of the steering angle. Preferably, the 
length of the time interval and/or a slope of the steering angle during that time 
interval can be evaluated, preferably within predefinable time windows. In this 
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way, different evaluation modes can advantageously be selected that can 
optionally be executed successively. 

According to yet another feature of the invention, the length of the time 
interval and/or the slope can be compared with at least one predefinable limit 
value, wherein advantageously a frequency is monitored by which the at least 
one limit value is exceeded during a predefinable time interval. This makes it 
possible to easily detect the attention level, in particular its change over time. 

Moreover, according to an advantageous feature of the invention, at least one 
action can be initiated when the at least one limit value is reached within a 
predefinable tolerance limit, when the at least one limit value is exceeded 
and/or when the at least one limit value is exceeded with a frequency greater 
than a predefined frequency. The action can specifically include an automatic 
steering intervention, an/or generation of at least one acoustic, optic and/or 
haptic message. The vehicle operator can thereby be alerted of a drop in 
his/her attention level, or the decrease in the attention level can be 
automatically compensated, which effectively reduces the probability for an 
accident due to the decreasing attention level of the vehicle operator. 
Optionally, stepped actions can be initiated depending on a detected attention 
level, in particular depending on the severity of a detected decrease in the 
attention level. In this way, the intensity of warning messages can be 
correlated with the decreasing attention level of the vehicle operator, such as 
giving the vehicle operator timely warnings, for example, to interrupt the trip 
for a brief rest and the like. 
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According to yet another advantageous feature of the invention, the steering 
angle and the steering wheel angle can be determined by evaluating an 
angular position and/or a rotation speed of the rotor of a servo motor of the 
electric steering assist and an angular position of a steering column. These 
signals are already available in vehicles equipped with an electric steering 
support (EPS) for other measurement and control tasks, thus obviating the 
need to install additional sensors for measuring and evaluating the phase 
relationship between steering angle and steering wheel angle. 

Advantageously, the phase difference can be determined by evaluating a 
steering torque of an electric steering assist, whereby existing sensors and/or 
their measured values can advantageously be used indirectly. The signal 
corresponding to the steering torque depends on the difference between the 
steering angle and the steering wheel angle, thereby providing a redundant 
signal for identifying the attention level. Accordingly, a single signal can be 
used to evaluate phase differences, which significantly simplifies in the 
accuracy and the implementation of the method. 

The object of the invention is also solved by a device with the features recited 
in claim 15. Advantageously, the device can be readily integrated in a vehicle 
by providing at least one sensor device that detects the steering performance 
of the vehicle and cooperates with a signal measurement and evaluation unit 
capable of generating a signal corresponding to the attention level, with the 
generated signal depending on a phase relationship between a steering angle 
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of at least one steerable wheel of the vehicle and a steering wheel angle. In 
particular, the device can be part of a control device of the vehicle. 

Additional advantageous embodiments of the invention are recited as 
additional features in the dependent claims. 

Embodiments of the invention will be described in detail hereinafter with 
reference to the appended drawings. It is shown in: 

Fig. 1 a schematic diagram of a steering assembly of a vehicle; 

Figs. 2 and 2a characteristic curves of a steering angle and a steering wheel 
angle; and 

Fig. 3 a block diagram of a device for detecting the attention level. 

Fig. 1 shows schematically a steering assembly 10 of an automobile. The 
steering assembly 10 includes a steering wheel 12 that is connected with a 
steering shaft 14 and operates on a steering rack 17 arranged in a steering 
box 16. The steering rack 17 is connected to tie rods 18 that operate on 
steering arms 20. The steering arms 20 support the steerable wheels 22 of 
the automobile, in particular the front wheels of the automobile. The steering 
assembly 10 includes an electric servo motor 24 that assists steering. A 
torsion rod 26 is integrated in the steering shaft 14. The steering shaft 14 is 
also provided with a steering angle sensor 28. 
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The design and the operation of the schematically depicted steering assembly 
10 are generally known and will therefore not be discussed in detail in the 
context of the present specification. 

It should be noted that when the steering assembly 10 is activated, a defined 
steering angle p of the wheels 22 is associated with each steering wheel 
angle a of the steering wheel 12 by way of the active connection between the 
steering wheel 12 and the steerable wheels 22. 

Fig. 2 shows in form of a curve 22* the time dependence of the steering angle 
p and in form of a curve 12' the time dependence of the steering wheel angle 
a based on the method of the invention. It is important to note that the 
steering angle p and the steering wheel angle a are not intentionally changed 
by the vehicle operator, but that these changes are caused by external 
effects, such as wind gusts, obstacles on the road, poor road conditions, poor 
tracking ability of the vehicle and the like. 

These external effects have in common that initially the steering angle p 
(curve 22') changes. As illustrated in Fig. 2, the steering angle p changes at a 
time U due to an external effect. Depending on the design, the change in the 
steering angle p is followed at time t 2 by a change in the steering wheel angle 
d, here shown as curve 12'. The time interval from ti to t 2 is determined by 
the steering mechanism, for example, by play in the steering assembly 10, by 
the response of the torsion rod 26 and the like. It is important to remember 
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that the method of the invention is applied only when the change in the 
steering wheel angle a is caused by the change in the steering angle (3. The 
vehicle operator detects the change in the steering angle p and corrects the 
steering wheel angle a with a time delay t 2 - ti. Stated differently: ideally, at 
the time t 2 , the vehicle operator notices that the steering angle p, i.e., the 
actual steering angle, differs from the desired steering angle p. This causes 
the vehicle operator to react by attempting to force the actual steering angle p 
to coincide with the desired steering angle p. On a presumably straight 
course, the desired steering angle p is 0°, while the desired steering wheel 
angle a is also 0°. The actual steering angle p at time ti increases due to 
external effects, and the actual steering wheel angle a also increases with a 
time delay t 2 - ti. 

At time t 3 , the vehicle operator notices that the actual steering angle p 
deviates from the desired steering angle p and attempts to compensate by 
turning the steering wheel 12. The steering wheel angle a then decreases 
when the vehicle operator turns the steering wheel 12, with the steering angle 
P also decreasing with a time delay that depends on the mechanical system. 
Accordingly, the steering wheel angle a at time U again corresponds to the 
desired steering wheel angle a, while the actual steering angle p at time t 5 
corresponds to the desired steering angle p. 

Conclusions about the attention level of the vehicle operator can thus be 
drawn from the evolution of the time interval t 3 - 1 2 . The more attentive the 
vehicle operator is, the earlier he/she will detect that the actual steering angle 
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P deviates from the desired steering angle p. In other words, the shorter the 
time interval t 3 - 1 2 , the greater the attention level of the vehicle operator. 

Fig. 2a shows an embodiment where the steering angle p changes due to 
short and impulse-like disturbances. Accordingly, the steering wheel angle a 
is actively corrected only following the short and impulse-like disturbance. 
The vehicle operator only reacts at time t 3l i.e., after the short and impulse-like 
disturbance has already passed. However, the vehicle operator must react 
because such short and impulse-like disturbances can adversely affect the 
straight course of the vehicle. Accordingly, the time interval t 3 - 1 2 is also an 
indication of the attention level of the vehicle operator. 

The evaluation can be performed as follows: 

The time interval t 3 - 1 2 is measured and compared with a limit value. If the 
time interval t 3 - 1 2 exceeds the limit value, then a warning signal is generated 
commensurate with the attention level of the vehicle operator. The warning 
signal can include acoustic, optic or haptic information. If the time interval t 3 - 
t 2 exceeds the limit value by a predefinable amount, then an automatic 
steering correction can also be applied, returning the actual steering angle p 
to the desired steering angle p. 

According to another feature of the evaluation method, the slope of the 
increase of the steering wheel angle a can be evaluated beginning at time t 2 . 
If the slope of the steering wheel angle a is the greater than a predefinable 
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slope, without detecting a reaction from the vehicle operator (time t 3 ), then a 
warning message can again be generated commensurate with the reduced 
attention level of the vehicle operator. An additional automatic steering 
correction can also be applied when a certain slope, i.e., predefinable limit 
value, is exceeded. 

In another approach, a ratio is formed between the slope of the steering angle 
P beginning at time ti and the slope of the steering wheel angle a beginning at 
time t 2 . Based on the fact that a defined steering wheel angle a is associated 
with each defined steering angle p, a detected decrease in the slope of the 
steering wheel angle a would indicate that the vehicle operator has noticed a 
deviation of the actual steering angle p from the desired steering angle p, 
prompting a suitable correction. Accordingly, this approach also provides an 
indication for the attention level of the vehicle operator. 

According to another feature of the evaluation method, the frequency with 
which the time interval from t 3 to t 2 exceeds a predefinable limit value can also 
be used as a reference variable. The time interval between t 3 and t 2 defines 
the reaction time of the vehicle operator in response to external steering 
effects. If the frequency with which the time interval between t 3 and t 2 
exceeds a limit value increases, albeit by a very small amount, then this could 
further indicate a decreasing attention level of the vehicle operator. 

Fig. 3 shows in form of a block diagram a device 30 for identifying the 
attention level of a vehicle operator. The device 30 includes a signal 
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measurement and evaluation unit 32 that is connected with a controller 34 of 
an electric steering assist (EPS) 36. The signal measurement and evaluation 
unit 32 can also be connected with a controller 38 of an electronic stabilizing 
system (ESP) 40. The signal measurement and evaluation unit 32 receives 
from the ESP system, for example, a signal 42 that corresponds to the actual 
steering angle p. The signal measurement and evaluation unit 32 can also 
receive from the EPS system 36 a signal 44 that corresponds to an angular 
position and/or a rotation speed of a rotor of the electric servo motor 24. A 
signal 46 that corresponds to an actual steering torque, measured by way of 
the torsion rod 26 can also be supplied. Accordingly, the signal measurement 
and evaluation unit 32 can use existing signals in vehicles equipped with the 
EPS system 36 and/or the ESP system 40. Additional sensor devices and the 
like are therefore not required for identifying the attention level of the vehicle 
operator according to the invention. The signal measurement and evaluation 
unit 32 generates a signal 48 that corresponds to the attention level of the 
vehicle operator and can be used to generate a corresponding action, for 
example a steering intervention or an acoustic, visual or haptic warning 
message. Moreover, the signal 48 can also initiate a stepped action 
commensurate with the attention level of the vehicle operator as detected by 
the aforedescribed evaluation, which can include, for example, initially an 
optical warning signal, followed by a combined optic and acoustic warning 
signal, and if necessary followed by an optic, acoustic and haptic warning 
signal. Finally, an automatic steering intervention can occur if the attention 
level of the vehicle operator is significantly impaired. 
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List of reference characters 



1 0 steering assembly 

12 steering wheel 

12' characteristic curve (curve of steering wheel angle a) 

14 steering shaft 

16 steering box 

17 steering rack 

18 tie rods 

20 steering arms 

22 wheels 

22* characteristic curve (curve of wheel angle (3) 

24 servo motor 

26 torsion rod 

28 steering angle sensor 

30 device for detecting the attention level 

32 signal measurement and evaluation unit 

34 controller for 36 

36 electric steering assist (EPS system) 

38 controller for 40 

40 electronic stabilizing system (ESP system) 

42 signal (corresponds to steering angle P) 

44 signal (corresponds to angular position and/or rotation speed of a rotor 

of the electric servo motor 24) 

46 signal (corresponds to the actual steering torque, measured via the 

torsion rod 26) 

48 signal (corresponds to the attention of the vehicle operator) 

a steering wheel angle 

P steering angle 

t n points in time 
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